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For a system moving away from equilibrium, we express the entropy production via a two-point 
correlation function for any time and any distance from equilibrium. The long-time limit gives 
the sum of the Lyapunov exponents for a general dynamical system expressed via the formula of a 
Green-Kubo type. 



I. INTRODUCTION 

cn ■ 

o : 

We discuss here how systems go away from the equilibrium under the action of external factors. An appropriate 
way to describe the process is to study the evolution of the density n which satisfies the continuity equation 

0) ■ ^+divnv = 0. (1.1) 



in 



Here n(t, r) is either a phase-space density or just plain density in space and v(t, r) is either a velocity field denning 
the phase space dynamics or the velocity field in space. We consider a compact phase space and assume that the total 
mass is conserved: J n(t,r) dr = 1. Equilibrium is generally characterized by smooth measures like microcanonical 
r ^~ l distribution over the energy surface in the phase space or just uniform density in space when the flow is incompressible. 
I— A ■ Equilibrium state realizes the maximum of the Gibbs entropy 

u : f 

£H . S = ~ n(r)lnn(r)dr (1.2) 



> 

X 



and is given by n = const = l/V. This state is not stationary if v(t, r) is compressible that is lj = divv ^ 0. If the 
system is initially at equilibrium then a compressible flow move it away from it. The density field n(r,t) is getting 
H ' inhomogeneous and the Gibbs entropy starts to decrease. This decrease can be interpreted as the entropy flux from 
^ | the system to the environment that provides for compressibility of the velocity field (for a closed Hamiltonian system 
lj = 0). Our main interest here is in the entropy production rate which can be expressed via the velocity divergence: 

m ■ 

^ ; ^ = j drn(r,t)cj(r,t) = J w(q(t,x),t) y , (1.3) 

The main feature of our approach is the application of Lagrangian description with trajectories q(t, x) defined by 
q = v(q, t) and q(0,x) = x. Our main result derived below is the formula for the entropy production rate at an 
£^ ' arbitrary time in terms of the two-point correlation function along the Lagrangian trajectories: 



d 2 S ( d-x 

_ = - j o;(x, 0) W (q(t, x), t) - = («(Q) W (t)> (1.4) 
dt{uj(0)uj(t'))dt' (1.5) 



d£ _ I* 

~dt ~ J 

The formula holds either for time-independent v(r) or for a statistically steady v(f, r). Near equilibrium, (|1.4fl is a 
well-known Green-Kubo formula (see, e.g. (5.7) in [l|). It is remarkable that the entropy production is expressed via 
the pair correlation function not only near equilibrium but in any state. 

Equation (|1.5|) gives dS/dt < at short times which is physically quite natural since the entropy has nowhere 
to go but down. When the velocity field is steady (or statistically steady) the density field may tend to a non- 
equilibrium steady state (see 0, 0] and the references therein). Examples of such states are Sinai- Ruelle-Bowen 
measures in hyperbolic dynamical systems 0, Q . The steady state is characterized by the limiting entropy production 
rate lim^oo S = J2^i- Here ^ s the sum of Lyapunov exponents A, if the latter exist. This sum is generally 

non-positive 0, . We observe that it obeys the formula that looks exactly the same as the Green-Kubo formula: 



(w(0)u(t))dt < 0. (1.6) 



If the non-equilibrium steady state density fj, is smooth then its Gibbs entropy is finite and necessarily lim^oo S — 
^2 Aj = 0. It is often the case that /i is singular, the simplest example is steady v(r) in one dimensional case where 
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n accumulates in the stagnation points. Generally for such states S — < that does not contradict stationarity 
since S = — oo where the measure is singular. Constant flux of entropy from the system to the environment is an 
important feature of these states. 

We see that the entropy production has the same sign both at the beginning and at the end of the evolution. How 
it behaves in between may depend on the system. In particular, it follows from (|1.4|l that when two-point correlation 
function of the velocity divergence does not change sign, the entropy production rate S monotonically decreases from 
in equilibrium to its (negative) minimum realized in the non-equilibrium steady state with singular density /i. Entropy 
decrease corresponds to the increase of order in the system. 



II. GENERAL CONSIDERATIONS 



We consider first a smooth dynamical system defined by a steady velocity field v: 

f-vW, (2-D 

where x is the phase space coordinate of the system. For most part we assume that the phase space is the finite 

volume V region in d— dimensional Euclidean space even though generalizations are possible. Velocity field defines 
the flow q(i, r) in the phase space by 

^M =v(q ( t , r )), q(0,r)=r. (2.2) 

Let us define 

An important relation between q(t, r) and v(r) holds 

v(q(f,r))=W(t,r)v(r), (2.3) 

which allows, in particular, to describe the evolution of the functions /(q(£, r)) defined on trajectories. Using 1)2.3)1 
we have for any differentiable / 

|/(q(i,r)) = (v(r) • V r )/(q(t,r)) = -a,(r)/(q(i, r)) + V r • [v(r)/(q(i, r))]. (2.4) 

We now integrate it over the space: 

| J */(q(t,r)) = - J £ W (r)/(q(f,r)) = -<o;(0)/(t)) , (2.5) 

yf(r) - J y/(q(t,r) = j\u(0)f(t'))dt> , (2.6) 

where we assumed that the space integral of the last term in l|2.4|l vanishes because it can be written as an integral 
over the boundary. This is true in the periodic case or in the case where the normal component of velocity vanishes (it 
might be interesting to consider the cases where boundary is important as well). We defined the correlation function 

(9(0)f(t)) = J y<?(r)/(q(i,r)) . (2.7) 

We shall see below that our main result 1)1.4)1 is a particular case of 1)2.5)1 . Integrating the equation 1)2. 6)1 over time we 
have 

dr , 1 f* ,., f dr ., ,., . f l #X1 ,., 1 



v f(r) - -J dt> J -/(q(*',r) = J (w (0) f(t'))dt' --J t> (u(0)f(t'))dt' . (2.8) 

Let us consider what may happen with Equations 1)2. 6|) and 1)2. 8|l when t — ► oo. From Equation 1)2.6)1 we observe that 
provided J Q (uj(0)f(t))dt exists there must also exist a finite limit of the spatial average 



f dr f dr f°° 



(2.9) 
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If we choose the initial state for as a constant, no(r) = nit = 0, r) = l/V, then (|2.9(l can be written as follows: 

lim / %f{v)n{t,v) = [ %f{v) - [°° (u(0)f(t))dt. (2.10) 



t-oo j v w v ' 7 y 

This suggests that the finiteness of temporal correlations i.e. the existence of the integrals (ui(0)f(t))dt for 
continuous / is equivalent to the existence of the limiting non-equilibrium state characterized by the probability 
measure fiy lm = lim t ^ oc n(r,t). Note that the difference of the non-equilibrium state measure ny lm and equilibrium 
measure E satisfies 



- E{f) = - j (u(0)f(t))dt, MUm(/) = J /d/ium, #(/) = y y/(r). 
Let us now consider Equation (|2.8p . It involves a weaker limit 1] 



(2.11) 



1 '* 



lim - / n(r,t')dt' 

t— *OQ t 



The existence of this limit is equivalent to the convergence of the subtracted correlation integral 

»M~E{f)=- Urn 



(u(0)f(t))dt - \ I t'{w{Q)f{t'))dt' 



t 



(2.12) 



We have /i a v(/) = Wim(/) where f Q °° {u(0)f(t))dt exists. 

A limit of the type used in /x av appears where one considers the sum of Lyapunov exponents Xi (r) (for the 
discussion of Lyapunov exponents see 0, 0)- That sum determines the growth rate of an infinitesimal volume 
initially located at r 

y Xt (r) = lim lndet ^' r) = lim i C w (q(tf, r)df. (2.13) 

^ — ' t^oo £ t— too £ 

We observe that is represented as a time-average of a function on the phase space. This is a unique combination 
of Xi representable in such a form. Using Equation (|2.8I) we have 

/ ^YX l (r) = - lim [/ (uj(0)u)(t'))df - - [ t 1 (oj(0)uj(t'))dt'] = - [ (w(0Wf))di, (2.14) 

where the last equality holds provided the integral exists. We used E(u) = assuming that the integral over 
the boundary vanishes. The above formula holds for systems whose stationary measure is arbitrarily far from the 
equilibrium one and nevertheless it has a remarkable resemblance to the Green-Kubo formula holding near equilibrium. 
Note that it suggests that J dr^Xi < always. This will be proved in the next section. Here we note that 
J dr ^2 Xi < signifies that n is singular. Therefore, the criterium of singularity of the non-equilibrium measure is 

/~MoMf)>«ft>o. 

The above relations are simplified for systems satisfying the SRB theorem that guarantees the equality between 
temporal average and average with respect to the limiting measure for any continuous /: 

lim - j f(q(t',v))dt' = f /d^SRB. (2.15) 

t->OQ t Jo J 

The above limit holds for almost all r in the sense of the usual volume in Euclidean space and fisBB is called the SRB 
measure Et ■ If the theorem holds we have 

1 I*. . , _ 1 



lim - / (g(0)f(t'))dt' = E(g)n(f), lim - / (oj(0)f(t'))dt' = . 

t— oo t J t^oo t Jo 

Note that /jsrb satisfies the relation 12.12(1 satisfied by fj, av . For SRB-theorem systems X^( r ) i s constant almost 
everywhere and we have 

/>OC 

VA i = - / (u>(0)oj(t))dt. (2.16) 
Jo 

We now apply the relations of this section for the investigation of the evolution of the entropy which possesses some 
unique properties. 
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III. ENTROPY 



The evolution of the entropy is closely related to the evolution of infinitesimal volumes in the phase space. Indeed, 
let us associate with each fluid element initially located at r the density of its Gibbs entropy (|1.2|) : 

s(r,t) = -lnn(q(t,r),t), S(t) = J dr n (r)s(r, t). (3.1) 

where 7io(r) = n(r,t = 0). The same quantity u)(q[t, r)) determines the time derivative of both the entropy density 
and the logarithm of the ratio of infinitesimal volumes v(t)/v(0): 

^=«(q(*,r)) = (3.2) 

We conclude that the entropy associated with each fluid element satisfies 

s(t, t) - S (r, 0) = f w(q(f , r)) dt', lim ' (r ' t] ~ ^ ° } = V A*. (3.3) 

This property of evolution of s(r, t) holds for almost all r in the limit t — > oo. At finite times however one can observe 
arbitrarily large deviations of [s(r, t) — s(r, 0)]/t from These deviations are the subject of the Evans-Searles 

formula which simple derivation within our formalism we now present. Our approach here is based on the trivial 
observation that q(i, q(— t, r)) = r. Differentiating that we derive a useful identity Q 



dq t (t,r) = ( %(-t,r) 

5r J r=q(-t,p) V 5r J 



(3.4) 



We can now relate the volume fraction of the trajectories that during time t change their entropy density by some A 
to the volume fraction of the trajectories with the change —A under the time-reversed evolution. We have 

f dr f dr 

/ ■x7 <5 (- mdeta i?i(-*! r )+ A ) det9 j9i(-*> r ) = / y 5 (- mdct <9j%(^ r )lr=q(-t : r) - A)dcta j g. i (-<,r) 
f dr 

= I y5(-lndetd jqi (t,r)-A) (3.5) 



It follows that the measures of As(t, r) = s(0, r) — s(t, r) obey 

J drS (As(t,r) - A) 



J drS (As(-t,r) + A) ' ' 

In the case of time-reversible dynamics, J dr 5 (As(— t, r) + A) = J dr S (As(t, r) + A) and 

Jdr6(As(t,r)-A) A 
JdrS(As(t,r)+A) 6 ' 



(3.6) 



(3.7) 



which says that, starting from equilibrium, the probability to have the entropy change A is by factor exp(A) larger 
than the probability to have the entropy change — A. That relation was first established by Evans and Searles The 
probability is defined here with respect to Lebesgue measure (the volume fraction occupied by respective trajectories) 
and the relation is valid for any time. Recasting the above equation in the form 

JdrS (e(t.r)-a) As(t,r) 

JdrS(e(t,r) + a) = CXP H ' ^ V) = ( } 

one can compare it to the Gallavotti-Cohen formula [To| : 

J dfiS (e(t, r) — a) 
J d^iS (e(i, r) + a) 



= exp [at] , (3.9) 



that holds at large t. Probability in l|3.9|l is defined with respect to the SRB measure. Comparison between (|3.8|l and 
(|3.9|) is discussed in [Tl| . 
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Let us now consider more closely the density of the entropy production rate dts(t, r) = iv(q(t, r)). According to the 
general formula 1)2. 4f> we have 

d 2 t s{t, r) = »w(q(t, r)) + V r • [v(r)w(q(t, r))]. (3.10) 

Both cj(q(t,r)) and its time derivative can have arbitrary sign. However, the above formula for d 2 s(t,r) suggests 
that the global quantities like space integrals can exhibit some general properties. The relation (|3.3|) for the entropy 
density implies an analogous relation for the entropy 

S(t)-S(0)=J dt' j drnviv^ W ,t)), Um S(f) ~ S(0) =]>>■ (3.11) 

Note that for systems with r- independent Aj ( r ) the last expression equals Aj • Generally, considering the case 
Tio(r) = const we find 

^A,<0, (3.12) 

which is expected from the Equation 1|2.6[) . Indeed since among all the densities having a given normalization the 
maximal 5* corresponds to a constant density (see Appendix and the evolution conserves normalization, we have 
S(t) — 5(0) < with equality holding only if the flow brings the density back to the constant at some time t. The 
relation (|3.12|) was demonstrated before 0, El • Another interesting quantity is the entropy production rate that can 
be written as 

r(t) = ^ = J no(r)w(q(t|r))dr = J dm(r,t)w(r) (3.13) 

For an arbitrary no(r), the entropy production rate can have any sign at small t. The most interesting case is the 
case of no(r) = const where the evolution of n(r, t) is that from equilibrium to the non-equilibrium steady state 
characterized by the SRB measure. In this case we have 



T(t) = J £ W (q(t|r)). (3.14) 



Clearly T(0) = 0. Under the condition of sufficiently fast temporal decay of correlations (existence of / °° tdt(ui(0)u>(t))) 
it follows from the analysis of the Sect. ITT1 that 

lim r(t) = V Ai < 0. (3.15) 

The case ^2 Aj = is the case where the steady non-equilibrium state a does not exchange entropy with the environ- 
ment. We wish to consider Ai < 0. Then T(t = oo) < 0. We also should have T(t) < at small t since at these 
times n(t, r) goes away from the constant giving the maximum to 5. It is natural then to ask what flows correspond 
to F(i) being a monotonic decreasing function of t reaching its minimum in the non-equilibrium steady state. This 
property cannot be general: if the flow brings back n(t, r) close to its original constant value (not exactly the same to 
have / dr A, < 0) then /„ T(t')dt' « and T(t) chan ges sign. To understand better the evolution of T(t) consider 

^ = J drn (r)[(v(x) • V x )w(x)] x=q(t | r) = - J drn (r)w(r)w(q(i|r)) + J drn (r)V r ■ [v(r)w(q(i|r))] , (3.16) 

where we used the formula (|3 . 1 0|) . We observe that for v such that v • Vuj < everywhere we have T(t) < and the 
conjecture on the monotonic decrease of T holds. Note that the opposite case v ■ Vw > would violate the possibility 
to integrate by parts J v • Vw = — J u' 2 < 0. 

We now concentrate on no(r) = 1/V case where 



^ = -<u>(0Mt)>, r(t) =-j\cj(0)u;(t'))dt' 



(3.17) 



Clearly at small t we have f (t) < 0. The above relation allows us to introduce the criterium of the generalization of the 
principle of maximal generation of entropy that holds near equilibrium. If the system possesses positive everywhere 
correlation function (u>(0)u>(i)} (that implies, in particular Ai < 0) then on its way from equilibrium to the non- 
equilibrium steady state the system gives more and more entropy to the environment with the rate that reaches 
maximum in the steady state. 

Let us summarize our results on the entropy production rate T(t). The first question is the sign-definiteness of T(t). 
We argued that even for no(r) = 1/V such assertion cannot be made generally. It seems that the correct language 
to consider this question and the question of the generalization of the maximum entropy production principle to the 
strongly non-equilibrium situations is to consider T(t). We have shown that the latter is equal to minus the value of 
an auto-correlation function at time difference t. 
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IV. GENERALIZATION FOR A TIME-DEPENDENT VELOCITY WITH STATIONARY STATISTICS 



We generalize the above results to the case of time-dependent velocity v(t, r). The phase-space trajectories q(t|i', r) 
depend now on both the initial time t' and the final time t and are characterized by 



dc0\t',T) 
Ft 



We introduce 



= v(q(t|i',r),t), q(t'|t',r)=r . 
%(t|t',r) 



(4.1) 



W tJ (t\t',v) 



<9r. 



To establish the generalization of i|3.6fl we use the same proof replacing the function q(— t, r) by q(0|t, r). For example 
we have 



i(*|0,r) 



/%(0|t,r) 



We find the identity 



' 3 r=q(0|t,r) V ® r j 

Jdr5(-lndet%i(t|0,r)/< - a) 
JdrS(- lndet d j q l (0\t, r)/t + a) 



— exp [at] 



(4.2) 



(4.3) 



that holds for any v(i, r). If v(t, r) has stationary statistics, with the average defined by the spatial integration, 
then one can replace qi(0\t,r) by (&(— 1 10, r) in the denominator of the above formula and the formula 13.6|) results. 
Moreover if the statistics is time-reversible we arrive at the equation 



fdr6(e(t, r) - a) 
J drS(e(t,r) + a) 



exp [at] 



(4.4) 



completing the generalization. 

Next we consider the entropy production rate for the case no(r) = 1/V 



r(t) 



«(*, q(t,r)) 



dr 
V' 



(4.5) 



Direct time differentiation of the above equation is not very useful in this case: we have no control over dtOJ. The idea 
is to manipulate the integral recasting it in the form more suitable for the time-differentiation. Changing variables 
y = q(0|t, r) we find 



r(i) = / w(*,y)exp 



uj(q(t'\t,y),t')dt' 



dy 
V 



We now assume stationarity that is we assume that the above average is equal to 



r(i)= J w(y,0)exp - J u(q.(t'\y),t')dt' 
This allows us to avoid the appearance of d t 0J in T. We have 



w(y,0)w(q(-t|y), -t) exp 



s(q(t'\y),t')dt' 



dy 
V 



dy 
V 



(w(0)o;(i)), 



(4.6) 



(4.7) 



(4.8) 



where the last equality is obtained by getting back in the integral to the variable r = q(i|0,y). The corresponding 
expression for the sum of Lyapunov exponents follows. This completes the generalization of the main results derived 
for the steady velocity field to the case of the time-dependent velocity with stationary statistics. If integrating over 
space does not guarantee stationarity, i.e. coincidence of (|4.6I I4.7fl . and one needs to add average over velocity 
ensemble, then (|1.5|) and 14.41) are also valid after such ensemble average. 
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We make a general remark on the entropy properties which are not related to the dynamics. We use the fact that 
In x — 1 + 1 jx > (here x > 0) with the equality reached only at x = 1. It follows that for any two normalized 
functions n and n' we have 



with the equality reached iff n = n' . The above inequality says that entropy considered as expectation value over 
some probability distribution n of minus logarithm of arbitrary other distribution n' is minimal where n 1 = n. An 
interesting conclusion follows for a compact space with volume V. We have for any distribution n 



with the equality reached iff n is uniform. A compact space is analogous to the probability space consisting of finite 
number of events in that one can define the entropy that is bounded from above by the maximal value reached at the 
uniform distribution. We also have that 



APPENDIX A: PROPERTIES OF THE GIBBS ENTROPY 




(Al) 




(A2) 




(A3) 



In particular, using the above equations for n = n(r, t) we find from Eq. (|A"2|l that the sum of forward in time 
Lyapunov exponents is non-positive while the last equation implies the same conclusion about the sum of backward 
in time Lyapunov exponents. 



